Automated discovery using textual analysis

ABSTRACT

An example method includes receiving text from a plurality of documents, segmenting text received text of the plurality of documents, calculating a frequency statistic for each segment of each document, determining segments of potential interest of each document based on calculated frequency statistic, calculating distances between each document of the plurality of documents based on a text metric, and storing segments of potential interest of each document and the distances in a search database. The method may further include receiving a search query and performing a search of information contained in the search database, partitioning documents of search results using the distances, for each partition, determining labels of segments of potential interest for documents of that particular partition, the labels being determined based on a plurality of frequency statistics, and providing determined labels of segments of potential interest for documents of each partition.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of U.S. patent applicationSer. No. 14/481,546 filed Sep. 9, 2014 and entitled “Automated DiscoveryUsing Textual Analysis,” now U.S. Pat. No. 9,892,110, which claimspriority to U.S. Provisional Patent Application Ser. No. 61/875,641filed Sep. 9, 2013 and entitled “Systems and Methods for TextualAnalysis,” which are hereby incorporated by reference herein.

TECHNICAL FIELD

The present disclosure generally relates to text analysis of a pluralityof documents and, more particularly to techniques for advertisementrevenue sharing with partners that preinstall applications on digitaldevices.

BACKGROUND

Keyword based text searching is ubiquitous. For example, Google utilizesa fairly typical keyword-based search technology (brilliantlyimplemented to scale). Keyword searches find all the documents matchingsome pattern of text (e.g., usually the presence of some collection ofwords) and returns a list of documents sorted by “value.” In the case ofGoogle, the corpora is that part of the world-wide-web accessible totheir crawlers, and the value function makes use of massive human effortin choosing which pages to link, and likely by keeping track of whichpages people select when a given search is completed. One difficultywith such searches is they do not make any use of the intrinsic contentsof the corpus (if Google did not have access to all this humanevaluation, the search would be poor), and the results are returned as a(usually very long) list.

Keyword search can be improved by having thesauri augment the set ofwords, but if the corpus is private, the value function is necessarilyvery poor.

SUMMARY

In various implementations, an exemplary method includes receiving textfrom a plurality of documents, segmenting text received text of theplurality of documents, calculating a frequency statistic for eachsegment of each document, determining segments of potential interest ofeach document based on calculated frequency statistic, calculatingdistances between each document of the plurality of documents based on atext metric, and storing segments of potential interest of each documentand the distances in a search database. The method may further includereceiving a search query and performing a search of informationcontained in the search database, partitioning documents of searchresults using the distances, for each partition, determining labels ofsegments of potential interest for documents of that particularpartition, the labels being determined based on a plurality of frequencystatistics, and providing determined labels of segments of potentialinterest for documents of each partition.

The method may further comprise displaying labels of segments ofpotential interest for documents of each partition. In some embodiments,the method may further comprise generating a graph of nodes and edgesconnecting nodes, where each node represents a document of the searchresults and each edge between nodes is based on the distances.

The frequency statistic may be a log likelihood function. In someembodiments, a segment of potential interest is determined by comparinga related log likelihood score associated with the segment to alikelihood threshold. The text metric may be or include a cosine termfrequency-inverse document frequency (tf-idf).

In some embodiments, the method may further comprise filtering the textto remove common or unwanted phrases. In various embodiments, the methodmay comprise approximating a distance measure between two documents inthe search results using a Dijkstra's algorithm.

An exemplary system comprises a corpus module, a text selection module,a distance module, and a search module. The corpus module may beconfigured to receive text from a plurality of documents. The textselection module may be configured to segment text received text of theplurality of documents, to calculate a frequency statistic for eachsegment of each document, and to determine segments of potentialinterest of each document based on calculated frequency statistic. Thedistance module may be configured to calculate distances between eachdocument of the plurality of documents based on a text metric. Thesearch database may be configured to store segments of potentialinterest of each document and the distances in a search database.

The system may further comprise a search module, a partition module, anda label module. The search module may be configured to receive a searchquery and to perform a search of information contained in the searchdatabase using the search query to identify documents for searchresults. The partition module may be configured to partition documentsof search results using the distances. The label module may be configureto, for each partition, determine labels of segments of potentialinterest for documents of that particular partition, the labels beingdetermined based on a plurality of frequency statistics, each frequencystatistic being associated with a document for that particularpartition, the label module further configured to provide determinedlabels of segments of potential interest for documents of each partitionto search client for display.

A non-transitory computer readable medium may comprise executableinstructions, the instructions being executable by a data processingdevice to perform a method. The method may comprise receiving text froma plurality of documents, segmenting text received text of the pluralityof documents, calculating a frequency statistic for each segment of eachdocument, determining segments of potential interest of each documentbased on calculated frequency statistic, calculating distances betweeneach document of the plurality of documents based on a text metric, andstoring segments of potential interest of each document and thedistances in a search database. The method may further include receivinga search query and performing a search of information contained in thesearch database, partitioning documents of search results using thedistances, for each partition, determining labels of segments ofpotential interest for documents of that particular partition, thelabels being determined based on a plurality of frequency statistics,and providing determined labels of segments of potential interest fordocuments of each partition.

BRIEF DESCRIPTION OF THE DRAWINGS

The patent or application file contains at least one drawing executed incolor. Copies of this patent or patent application publication withcolor drawing(s) will be provided by the Office upon request and paymentof the necessary fee.

FIG. 1 is an illustration of an environment including data sources, atext analysis system, and a client device each in communication over anetwork in some embodiments.

FIG. 2 is a block diagram of the text analysis system in someembodiments.

FIG. 3 is a flowchart for text analysis, receiving a search request, andproviding search results in some embodiments.

FIG. 4 is a flowchart for determining frequency statistics anddetermining segments of potential interest based on the frequencystatistics in some embodiments.

FIG. 5 is a flowchart for partitioning search results in someembodiments.

FIG. 6A and 6B depict other flowcharts for partitioning search resultsin some embodiments.

FIG. 7 is a flowchart for generating labels associated with segments ofpotential interest of document members of a partition using a frequencystatistic in some embodiments.

FIG. 8 is a flowchart for restricting a set of documents in someembodiments.

FIG. 9 is a flowchart for receiving an expanded selection in someembodiments.

FIG. 10 is a functional block diagram of a digital device in someembodiments.

FIG. 11A is an interface depicting a graph of search results and labelsfor partitions of the graph in some embodiments.

FIG. 11B depicts the labels and partitions of FIG. 11A.

FIG. 11C depicts the graph of FIG. 11A.

FIG. 12A is an interface whereby a user has selected a label (e.g.,processor) and a document selection list was generated showing a list ofdocuments including associated labels for each document in someembodiments.

FIG. 12B depicts labels and partitions of the graph including a selectedpartition.

FIG. 12C depicts the graph of FIG. 12A.

FIG. 12D depicts the document selection list of FIG. 12A.

FIG. 13A is an interface depicting a restricted selection by the user insome embodiments.

FIG. 13B depicts the labels and partitions of FIG. 13A.

FIG. 13C depicts the graph of FIG. 13A.

FIG. 13D depicts the document selection list of FIG. 13A showing adocument list associated with the two selected partitions.

FIG. 14A is an interface depicting a selection of a partition associatedwith the label of “wearable_computer” by the user in some embodiments.

FIG. 14B depicts the labels and partitions of FIG. 14A.

FIG. 14C depicts the graph of FIG. 14A.

FIG. 14D depicts the document selection list of FIG. 14A showing adocument list associated with the selected partitions

FIG. 15A is an interface of an expanded selection of the“wearable_computer” partition by the user in some embodiments.

FIG. 15B depicts the labels and partitions of FIG. 15A.

FIG. 15C depicts the graph of FIG. 15A.

FIG. 15D depicts the selected document of FIG. 15A.

Like reference symbols in the various drawings indicate like elements.

DETAILED DESCRIPTION

FIG. 1 is an illustration of an environment including data sources102A-N, a text analysis system 104, and a client device 106 each incommunication over a network 110 in some embodiments. The data sourcesinclude any number of digital devices that store documents. A digitaldevice is any device with a processor and memory. Data sources include,but are not limited to, web servers, file servers, mail servers, ftpservers, storage networks, storage devices, or any device with acomputer readable medium containing documents.

A document is any electronic file containing text. A document mayinclude other objects such as graphs, tables, pictures, animation,audio, and/or the like. Documents received by the text analysis system104 may be or include web pages, email, word processing documents,spreadsheets, ebooks, drawings, transcriptions, media objects, slides orthe like from any number of data sources 102A-N. In some embodiments,the document may include images of text that may be converted into textby the text analysis system 104.

The documents may be received from any number of data sources 102A-Nincluding, for example, one or more systems (e.g., digital devicesincluding systems or servers that may include one or more libraries). Inone example, the text analysis system 104 may receive any number ofpatent documents (e.g., patent applications, file wrapper documents, orthe like) from the US Patent and Trademark Office. In other examples,the text analysis system 104 may receive any number of ebooks fromProject Gutenberg, email from corporate email servers, financialdocuments from accounting systems, tax documents from governmentalagencies, contracts from law firms, case law from judicial courtpublishers, science journals from libraries, or the like.

The text analysis system 104 may retrieve or receive documents from anynumber of data sources 102A-N. As described in greater detail withregard to FIGS. 3-7, the text analysis system 104 prepares a searchdatabase using the text from any number of data sources 102A-N. Forexample, generally, the text analysis system 104 may generate a corpusset of text from any or all of the documents. In various embodiments,the text analysis system 104 calculates a frequency statistic forsegments of text in the corpus set and calculates distances betweendocuments in corpus set using at least one text metric. For eachdocument, the text analysis system 104 may store the text, associatedfrequency statistic, document metadata (e.g., author, creation data,description, type of document, or the like), and distances between thedocument and any number of the other documents in a search database.

The text analysis system 104 may receive a search request from theclient device 106. The search request may be any search query forinformation from the search database. The text analysis system 104 maygenerate search results based on the search query and the searchdatabase. In various embodiments, the text analysis system 104 performsa search using the search query on all of the text of the documents(e.g., not only segments associated with frequency statistics) and/ordocument metadata. The search results may include a subset of documentsin the search database (e.g., a subset of documents received by the textanalysis system 104.

The text analysis system 104 may partition the documents in the searchresults using distances generated using text metrics. For eachpartition, the text analysis system 104 may generate labels associatedwith text segments of interest to provide to the client device 106. Forexample, for each member document of a partition, the text analysissystem 104 may collect text segments of potential interest as well asthe related frequency statistic. The text analysis system 104 mayidentify a subset of the collected text segments of potential interestusing the collected frequency statistic and then generate one or morelabels for the text segments of the identified sub set.

It will be appreciated that some of the steps described herein may beperformed by the text analysis system 104 before a search query isreceived (e.g., preprocessing) or after the search query is received(e.g., in real time). Additional steps and/or functions may be apparentdepending on when functions are to occur.

The text analysis system 104 may provide the labels to the client device106. For example, the text analysis system 104 may provide searchresults, including the labels to the client device 106 in an interfacegenerated by the search client module 108. It will be appreciated thatany of the information related to the search query and the searchresults (e.g., any information contained in the search database or thedocuments associated with the search results) may be provided by thetext analysis system 104 and/or displayed to the user of the clientdevice 106.

The search client module 108 is an application that allows or enablesaccess to a search system. The search client module 108 may display aninterface that allows a user of the client device 106 to provide thesearch query to the text analysis system 104 and to receive searchresults (e.g., including the labels). The search results may be a listof documents responsive to the search query. The labels from the textanalysis system 104 may associated with any of the documents in the listof documents. The search client module 108 may receive further searchqueries, such as but not limited to, new search queries, restrictedselections, or expanded selections to further explore the search resultsand/or additional information associated with the search database of thetext analysis system 104.

In various embodiments, the user may interact with the search clientmodule 108 to retrieve documents from the search database of the textanalysis system 104 and/or retrieve documents from any number of datasources 102A-N. The search client module 108 may be an application suchas a browser or a dedicated application. The search results includinglabels may be displayed by the text analysis system 104 and/or theclient device 106.

The client device 106 is any digital device that may include the searchclient module 108. The client device 106 may, for example, be a personalcomputer, mobile device, wearable device, media device, laptop computer,smartphone, tablet, or the like.

A module is any hardware, software, or combination of hardware andsoftware. Although each system depicts one or more modules, it will beappreciated that any module may perform more or less functionality thatwhat is described herein. Further, each system may have any number ofmodules, processors, digital devices, or the like.

FIG. 2 is a block diagram of the text analysis system 104 in someembodiments. The text analysis system 104 may include a corpus module202, a text selection module 204, a distance module 206, a searchdatabase module 208, a search module 210, a partition module 212, alabel module 214, a restriction module 216, an expand module 218, anoptional graph module 220, and a search database 222. The corpus module202 receives a plurality of documents from any number of the datasources 102A-N and generates a corpus set of text associated with thedocuments. A corpus set is a collection of documents, or parts ofdocuments. For example, the corpus set may contain text or text segmentseach associated with one or more documents of the one or more datasources 102A-N. The corpus set may include all text of all documents oronly some text from all or some of the documents. In some embodiments,an association between text or text segments and the document thatcontains the text or text segments is also stored in the corpus set. Thecorpus set may be contained in any number of data structures (e.g.,databases, tables, arrays, queues, or the like) on any number of storagedevices (e.g., remote or local storage servers, hard drives, flashmemory, or the like).

The text selection module 204 may segment or parse parts of text fromone or more of the documents received by the corpus module 202 togenerate a first set of text segments. The text selection module 204 maysegment the text from any number of the documents of the corpus set inany number of ways. In some embodiments, the text selection module 204segments or parses text from one or more documents of the corpus setand, subsequently, may identify some of the segments of the text assegments of potential interest. In various embodiments, the textselection module 204 initially identifies segments of potential interestprior to generating text segments. It will be appreciated that the textselection module 204 may filter undesired text segments (e.g., mayremove some text segments initially identified as being of potentialinterest) or identify text segments as being of potential interest atany time.

In one example, for each document in the corpus set, the text selectionmodule 204 may optionally retrieve a dictionary of common terms thatidentify common parts of speech (e.g., some prepositions, conjunctions,and the like including, for example, “the” and “and”) and ignore phrasesof text using the dictionary of common terms. In various embodiments,the dictionary of common terms may include additional phrases that arespecific to a specific type of documents. For example, if the documentswere patent applications, the dictionary of common terms may identifyphrases that are common in many patent applications such as “patent,”“invention,” “disclosure,” “embodiments,” “examples,” “in some,”“detailed description,” “a system comprising:,” “a method comprising,”“claims,” and “abstract.” The text selection module 204 may identifystems of words (e.g., using a stemmer) to further identify roots forfiltering undesired terms or identifying segments of potential interest.

In some embodiments, the text selection module 204 utilizes naturallanguage processing (NLP) to segment each document and/or identify thesegments to include in the first set of text segments. The textselection module 204 may utilize NLP to select segments of the documentbased on parts of speech. For example, the text selection module 204 mayutilize NLP to select nouns, nouns followed by another noun (i.e., nounnoun patterns), adjective nouns (i.e., adjective noun patterns), andverbs. It will be apparent that the text selection module 204 may selectwords based on any pattern of words and/or parts of speech. The textselection module 204 may utilize any NLP software including, forexample, the Stanford NLP Library or the Natural Language Toolkit(NLTK). Each selected segment may be associated with the document wherethe particular selected segment originated.

In various embodiments, the text selection module 204 may utilize alikelihood function to generate frequency statistics for any number ofsegments in each document. For each document, the text selection module204 may utilize the likelihood function to identify segments (e.g.,phrases) that are unexpected (e.g., that appear in the document anunexpected of times). For example, the text selection module 204 mayutilize the likelihood function to identify the total number of times aphrase appears in all of the documents of the corpus set (i.e., theobserved phrase in the corpus) to enable a calculation of the expectednumber of times the same phrase appears in each document. If the phraseis in a document significantly more times than expected, the phrase(i.e., the segment) may be identified as a segment of potentialinterest. Examples of likelihood functions are further describedregarding FIGS. 3-5 herein. The search database module 208 may storesegments of potential interest in the search database 222 as describedherein.

The distance module 206 may calculate distances between documents fromthe data sources 102A-N using one or more distance metrics. In someembodiments, the distance module 206 calculates distances betweendocuments using at least one text metric. For example, the distancemodule 206 may utilize a term frequency-inverse document frequency(tf-idf) to calculate the distances. A distance is calculated usingtf-idf by determining a relative frequency of a segment (e.g., a word orphrase) in a specific document compared to the inverse proportion ofthat segment over the entire document corpus set. The tf-idf is wellunderstood in the art.

For example, the distance module 206 may determine tf-idfs of allsegments of potential interest in a first document. The distance module206 may also determine tf-idfs of all segments of potential interest ina second document. Subsequently, the distance module 206 may take acosine of the tf-idfs from the first document and the tf-idfs of thesecond document to compute a distance (i.e., a tf-idf cosine score usingtf-idfs of the first and second documents).

The search database module 208 may store segments of potential interestfrom the text selection module 204 in the search database 222. Invarious embodiments, the search database module 208 may store, in thesearch database 222, any of the text from any number of documents fromthe data sources 102A-N. For example, for each document, the searchdatabase module 208 may store a document identifier, all text of thatdocument, segments of potential interest from that document identifiedby the text selection module 204, frequency statistics for the segmentsof potential interest calculated by the text selection module 204,and/or associations between each segment of potential interest and thatdocument that contained the segment. Further, for each document, thesearch database module 208 may store, in the search database 222,document metadata, distances between that document and any number of theother documents of the corpus set, and/or any other information.Document metadata may include, for example, document type, author(s),publication date, publication source, location of document (e.g., URL oraddress), classification, subclassification, identifiers, genre,context, or any other information.

The search module 210 may receive a search request from the clientdevice 106. The search request may include a search query forinformation contained in the search database 222. The search query mayinclude words, numbers, and/or symbols or the like. The search module210 may perform a search of any information contained in the searchdatabase 222 using the search query received from the client device 106.For example, the search module 210 may perform a search of all text inthe documents (i.e., not segments of interest) and/or metadata containedin the search database 222. The search module 210 generates searchresults based on the search.

The partition module 212 partitions (e.g., groups) the search results.In various embodiments, the partition module 212 groups documentsidentified in the search results using the computed distances calculatedby the distance module 206 (e.g., the computed distances for eachdocument to each other document in the corpus set being potentiallystored in the search database 222).

In some embodiments, the partition module 212 selects a predeterminednumber of documents from the search results to create a guide set. Theselection may be at random. The partition module 212 may retrievedistances between each of the documents in the search results and eachof the members of the guide set. Subsequently, for each document in thesearch results, the partition module 212 may identify at least one ofthe closest members in the guide set using the retrieved distances toform a plurality of partitions. Exemplary partition processes arefurther described with regard to FIGS. 3, 5, 6A, and 6B.

For each partition identified by the partition module 212, the labelmodule 214 generates labels based on segments of potential interest ofmember documents of that partition. The labels may be displayed to theuser of the client device 106 and utilized to better inform the user ofinformation associated with at least one or more documents in the searchresults.

In various embodiments, for each partition, the label module 214 maycollect all frequency statistics of segments of potential interest forall documents that are members of that set. Using the frequencystatistics, the label module 214 may select a predetermined number ofsegments of potential interest. The label module 214 may adjust (e.g.,add or remove weight to) the frequency statistics as described herein.The label module 214 may generate labels describing or including theselected segments of potential interest.

The search module 210 may provide the search results, labels from thelabel module 214, and/or any other information to the client device 106.

The restriction module 216 may receive a restricted selection ofdocuments from the client device 106. For example, a user may select oneor more documents of a graph or one or more documents associated withlabels in an interface. In one example, the selection may be a subset ofdocuments of the search results (e.g., a restricted selection ofdocuments).

The partition module 212 may partition the restricted selected documentsas described herein (see steps 502-506 in FIG. 5 for example). Further,as similarly described, the label module 214 may generate labels usingthe restricted selected documents and the search module 210 may providethe identifiers of documents associated with the restricted selecteddocuments, new labels, and/or any other information to the client device106.

A process receiving a restricted selected of documents, performing therestricted search, and providing results is described with regard toFIG. 8.

The expand module 218 may receive an expanded selection includingselected documents from the client device 106. In some embodiments, auser of the client device 106 (e.g., the user of the search clientmodule 108) may select one or more documents, labels (e.g., associatedwith segments of potential interest of documents in the search results),or any other information associated with documents.

The expand module 218 may receive the expanded selection and maydetermine the nearest neighbors of documents in the corpus set todocuments in the expanded selection. For example, the expand module 218may identify documents associated with expanded selection (e.g., eitherby document identifier or by identifying documents related to selectedlabels, segments of potential interest, or any other information). Theexpand module 218 may determine a number of nearest neighbors (e.g., 20)of nearest neighbor documents in the corpus set using the distancescalculated by the distance module 206. The selected documents and thenearest neighbors may be included in an expanded selection set ofdocuments.

The partition module 212 may partition the expanded selection set ofdocuments as described herein (see steps 502-506 in FIG. 5 for example).Further, as similarly described, the label module 214 may generatelabels using the expanded selection set of documents and the searchmodule 210 may provide the identifiers of the documents in the expandedselection set, new labels, and/or any other information to the clientdevice 106.

A process receiving an expanded selection set, determining nearestneighbors, partitioning the selected documents and the nearestneighbors, generating labels and providing information to the user basedon the expanded selection set is described with regard to FIG. 9.

The optional graph module 220 may generate a graph of the search resultsin some embodiments. The graph may include nodes (e.g., balls) and edges(e.g., connections between nodes). In one example, each node of thegraph may represent a document of the search results.

Edges between nodes may be determined in any number of ways. Forexample, for each document in the search results, the optional graphmodule 220 may determine a number (e.g., 200) of nearest neighbordocuments in the corpus set using the distances calculated by thedistance module 206. For each particular document in the search results,the optional graph module 220 may determine if any of the identifiednearest neighbor documents (e.g., documents that are the nearestneighbor to the particular document) are part of the search results. Ifone or more of the nearest neighbor documents are part of the searchresults, then the optional graph module 220 may generate an edge or linefrom the particular node to each of the nearest neighbor documents thatare part of the search results.

In some embodiments, the optional graph module 220 may generate theedges based on a number of nearest neighbor documents in the searchresults.

The number of nearest neighbor documents may be predetermined, based onthe search results (e.g., number of documents in search results, size ofcorpus, distribution of documents based on distance, and/or the like),based on information from the search database 222, and/or based on thecorpus set.

FIG. 3 is a flowchart for text analysis, receiving a search request, andproviding search results in some embodiments. In step 302, the corpusmodule 202 receives documents and generates a corpus set. In variousembodiments, the corpus module 202 does not receive documents but ratherreceives text (e.g., all text or segments of text) from any number ofdocuments. In one example, the corpus module 202 may receive a copy oftext on any number of documents stored on the data sources 102A-N.

In step 304, the corpus module 202 may optionally filter the text toremoved common or undesired words or phrases (e.g., utilizing adictionary of common terms and/or dictionaries for specific types ofdocuments). Further, the corpus module 202 may filter the text to removetext based on parts of speech or any other pattern recognition.

It will be appreciated that the corpus module 202 may filter and/orsegment words to include in the corpus set.

In step 306, the corpus module 202 may segment text of documents incorpus set. In some embodiments, segments (e.g., phrases) may beidentified based on sentence structure and parts of speech. It will beappreciated that segments may include any number of words. For example,the corpus module 202 could examine ngram of different sizes. The corpusmodule 202 could scan text of a document, for example, to identifyngrams of different sizes that may be segments of potential interest.Identification of ngrams as well as determining that an ngram of anysize may qualify as a segment of potential interest may be based on NLPsoftware and/or a frequency statistic as described herein.

In step 308, the text selection module 204 may calculate a frequencystatistic of segments identified by the corpus module 202 for eachdocument. In some embodiments, each document may include a plurality ofsegments, each of the plurality of segments corresponding to a frequencystatistic. The frequency statistic may be based on a likelihood functionas described with regard to FIG. 4. The frequency statistic may bedetermined any number of ways.

In various embodiments, the text selection module 204 may identify anynumber of segments of each document as a segment of potential interest.For example, the text selection module 204, for each segment, the textselection module 204 may compare the frequency statistic or a version ofthe frequency statistic to a threshold to determine if the relatedsegment qualifies as a segment of interest (e.g., a segment that appearssignificantly more often than expected in a document). A process ofdetermining if a segment is a segment of potential interest is discussedwith regard to FIG. 4.

In step 310, the distance module 206 may determine distances between alldocuments in corpus set using text metric. As described herein, thedistance module 206 may determine distances between any two documentsusing the cosine tf-idf scoring using tf-idfs calculated for segments ofpotential interest of each document. It will be appreciated that anymetric, or combination of metrics, may be used by the distance module206 to determined distances.

In step 312, as discussed herein, the search database module 208 maystore the document identifier, all text of that document, segments ofpotential interest from that document identified by the text selectionmodule 204, frequency statistics for the segments of potential interestcalculated by the text selection module 204, and/or associations betweeneach segment of potential interest and that document that contained thesegment. Further, for each document, the search database module 208 maystore, in the search database 222, document metadata, distances betweenthat document and any number of the other documents of the corpus set,and/or any other information. Document metadata may include, forexample, document type, author(s), publication date, publication source,location of document (e.g., URL or address), classification,subclassification, identifiers, genre, context, or any otherinformation.

Although a search database 222 is depicted in FIG. 2, it will beappreciated that the search database module 208 may store all or some ofthe information in any number of databases at any location (e.g.,storage networks, multiple storage devices, and/or the like).

In step 314, the search module may perform a search on the storedinformation using a search query to generate search results. Asdescribed herein, the search module 210 may receive a search requestfrom the client device 106. The search module 210 may perform a searchof any information contained in the search database 222 using the searchquery received from the client device 106. For example, the searchmodule 210 may perform a search of all text in the documents (i.e., notsegments of interest) and/or metadata contained in the search database222. The search module 210 generates search results based on the search.

In step 316, the partition module 212 may partition documents in searchresults using the metric (e.g., text metric) on segments in searchdatabase. As described herein, the partition module 212 selects apredetermined number of documents from the search results to create aguide set. The selection may be at random. The partition module 212 mayretrieve distances (e.g., from the search database 222) between each ofthe documents in the search results and each of the members of the guideset. Subsequently, for each document in the search results, thepartition module 212 may identify at least one of the closest members inthe guide set using the retrieved distances to form a plurality ofpartitions.

In step 318, for each partition, the label module 214 determines labelsbased on segments of potential interest of member documents of thatpartition. For example, the label module 214 may collect frequencystatistics of segments of potential interest for all documents that aremembers of that partition. Using the frequency statistics, the labelmodule 214 may select a predetermined number of segments of potentialinterest (e.g., the segments of potential interest associated with thetop ten frequency statistics). The label module 214 may adjust (e.g.,add or remove weight to) the frequency statistics as described herein.The label module 214 may generate labels describing or including theselected segments of potential interest.

In step 320, the search module 210, label module 214 or optional graphmodule 220 may display, for each partition, features of member documentsand the labels for that partition. In some embodiments, the label module214 and/or the search module 210 provides the search results, includingfeatures of member documents and/or labels to the client device 106 fordisplay (e.g., by the search client module 108).

FIG. 4 is a flowchart for determining frequency statistics anddetermining segments of potential interest based on the frequencystatistics in some embodiments. In step 402, for each segment of adocument identified or generated by the corpus module 202, the textselection module 204 determines a frequency number of that segment inthe corpus set to generate observed(segment) value. For example, theobserved(segment) may be the number of times that segment appears in thecorpus set.

In step 404, the text selection module 204 determines the total numberof segments in corpus set as well as the total number of segments ineach document of the corpus set. In step 406, the text selection module204, for each segment, determines an expected frequency number of thatsegment in a document to generate expected(segment) value. For example,the expected number of times a segment is to appear in a singledocument, identified as “e,” is as follows:

${{Expected}({segment})} = {e = {\frac{{Total}\mspace{14mu}{Number}\mspace{14mu}{of}\mspace{14mu}{Times}\mspace{14mu}{Segment}\mspace{14mu}{in}\mspace{14mu}{Corpus}}{{Total}\mspace{14mu}{Number}\mspace{14mu}{of}\mspace{14mu}{Segments}\mspace{14mu}{in}\mspace{14mu}{Corpus}}\left( {{Total}\mspace{14mu}{Number}\mspace{14mu}{of}\mspace{14mu}{Segments}\mspace{14mu}{in}\mspace{14mu} a\mspace{14mu}{Document}} \right)}}$

In step 408, for each segment in a document, the text selection module204 determines the log likelihood frequency statistic (i.e.,Log_Likelihood(segment)) for that segment. For example, the textselection module 204 may determine an observed number of times a phraseactually appears in a single document, identified by “o,” as follows:Observed(segment)=o=Total Number of Times segment Appears in Document

The log_likelihood(segment) (i.e., LL) is, for example, calculated usinge and o as defined above as follows:

${{Log\_ Likelihood}({segment})} = {{LL} = {{{Observed}({segment})}{\log\left( \frac{{Observed}\mspace{14mu}({segment})}{{expected}\mspace{14mu}({segment})} \right)}}}$

The LL of a segment (i.e., Log_Likelihood(segment)) may be compared to alikelihood threshold to determine if the segment should be included inthe first set of text segments. The likelihood threshold may include anynumber of values, either positive or negative, to compare to the LL of asegment to determine if the segment appeared more often in the documentthan expected.

For example, the text selection module 204 may compare the LL of asegment to a first likelihood threshold that is a positive value todetermine if the segment appears more often in the document thanexpected. Similarly, for example, the text selection module 204 maycompare the LL of a segment to a second likelihood threshold that is anegative value to determine if the segment appears less often in thedocument than expected. Segments that appear more often than expected ina document and/or segments that appears less often in a document thanexpected may be identified as segments of potential interest and storedin the search database 222.

In some embodiments, only segments that appear more often than expectedin a document may be identified as segments of potential interest andstored in the search database 222. In some implementations, the LLfunction may include a maximum function to direct the value of a segmentthat appears less often in a document than expected to zero. This LLfunction, identified below as Log_Likelihood_Max(segment), may bedefined as follows:

${{Log\_ Likelihood}{\_ Max}({segment})} = {{Max}\left( {{{{Observed}({segment})}{\log\left( \frac{{Observed}\mspace{14mu}({segment})}{{expected}\mspace{14mu}({segment})} \right)}},0} \right)}$

The Log_Likelihood_Max(segment) as defined above may be compared to apositive likelihood threshold to determine if a segment should beidentified as a segment of potential interest and stored in the searchdatabase 222 based on whether the segment appears a sufficient number oftimes more than expected. It will be appreciated that the likelihoodthreshold may be adjusted depending on a sensitivity regarding how muchmore or less a segment is expected to appear in a document beforequalifying as a segment of potential interest.

In some embodiments, rather than comparing theLog_Likelihood_Max(segment) to the positive likelihood threshold, the LLor the Log_Likelihood_Max(segment) as described herein may be used inthe calculation of a Log_Likelihood_State(segment). TheLog_Likelihood_State(segment) may be utilized to determine if thesegment is a segment of potential interest.

In step 410, the text selection module 204 determines, for each segment,the Log_Likelihood_State(segment). In general, theLog_Likelihood_State(segment) may be calculated based on at least somesegments (e.g., potentially all segments) across any number of documentsin the corpus set. The Log_Likelihood_State(segment) may be defined asfollows:

${{Log\_ Likelihood}{\_ State}({segment})} = {\sum\limits_{Documents}\;\left( {{Log\_ Likelihood}({segment})} \right)^{2}}$

For example, for each segment in a document, the text selection module204 may determine the LL and/or Log_Likelihood_Max(segment) for asegment in all documents. Subsequently, the text selection module 204may square the LL and/or Log_Likelihood_Max(segment) of that particularsegment for each particular document and add together the scores togenerate the Log_Likelihood_State(segment) for that particular segment.As a result, the text selection module 204 may generate a set ofLog_Likelihood_State(segment) scores for these segments (e.g., allsegments) across any number of documents in the corpus set.

In step 412, each of the set of Log_Likelihood_State(segment) scores maybe compared to a likelihood state threshold to determine if each relatedsegment should be identified as a segment of potential interest andincluded in the search database 222 in step 414. For example, if aLog_Likelihood_State(segment) score of a first segment occurs anunexpectedly large number of times across many documents of the corpusset and that Log_Likelihood_State(segment) score is greater than thelikelihood state threshold, that first segment may be identified as asegment of potential interest. If a Log_Likelihood_State(segment) scoreof a second segment occurs few times across many documents of the corpusand that Log_Likelihood_State(segment) score is less than the likelihoodstate threshold, the second segment may not be identified as a segmentof potential interest.

Although this example illustrates utilizing likelihood functions todetermine which segments to identify as segments of potential interest,in some embodiments, the Log_Likelihood_State(segment) may be comparedto a likelihood state threshold to determine if the segment should beremoved from search database as a segment that is no longer of potentialinterest.

FIG. 5 is a flowchart for partitioning search results in someembodiments. In step 502, the partition module 212 may select a numberof documents from search results to generate the guide set of documents.The partition module 212 may select the documents at random or in anymanner. For example, the partition module 212 may utilize a sizefunction based on distances between documents to determine if there aset of documents that are close (e.g., a large number of documents withshort distances between them) thereby identifying potentially denseareas. The partition module 212 may select any number of documents toinclude in the guide set based on the distances or in any other manner.

The partition module 212 may select any number of documents. The numberof documents selected for the guide set may be predetermined (e.g., 8).In some embodiments, the partition module 212 may determine the numberof documents in search results and determine a number of documents toselect from the guide set based on the number of documents in the searchresults. The partition module 212 may determine the number of documentsto select in the guide set in any number of ways.

In step 504, the partition module 212 retrieves distances between eachdocument in search results and each document in guide set from searchdatabase 222. For example, for each document stored in the searchdatabase 222, the search database 222 may store calculated distancesbetween that document and all other documents of the corpus set. Thepartition module 212 may retrieve distances between a first document andall other documents of the guide set (e.g., potentially not retrievingdistances between the first document and other documents of the searchresults that are not in the guide set).

In step 506, the partition module 212, for each document in the searchresults, identifies at least one of the closest documents in the guideset based on the retrieved distances to form a plurality of partitionsof documents of the search results. For example, once the partitionmodule 212 identifies a document in the guide set that is closest to afirst document (e.g., the first document not being in the guide set butbeing in the search results). A partition may be created that includesat least the identified document in the guide set that is closest to thefirst document. Any number of partitions may be created. In someembodiments, each partition may include at least one document from theguide set. Each document in a guide set may be exclusive to onepartition.

It will be appreciated that FIG. 5 may stop and partitions created forthe label module 214 to identify labels for each partition, the labelsbeing associated with segments of high frequency in the documents forthat partition (as described in FIG. 7).

Steps 508-514 may be utilized to improve partitions by removing somepartitions with few member documents and splitting partitions for setsthat have a large number of member documents.

In step 508, the partition module 212 determines a number of documentsin each partition. In step 510, the partition module 212 may determineif the number of documents for any partition is less than a partitionsize threshold (e.g., if a partition has only two document members andthe minimum partition size threshold is five). The partition sizethreshold may be predetermined or determined in any number of ways. Insome embodiments, the partition module 212 determines the partition sizethreshold based on the number of documents in the search results and/ora distribution of distances of the documents in the search results.

If the number of documents in a partition is less than the partitionsize threshold, in step 512 the partition module 212 removes anydocuments that are members of the partition from the guide set. Forexample, if there is one document in a partition that is a member of theguide set, the partition module 212 will remove that document from theguide set.

In step 514, for each document removed from the guide set, the partitionmodule 212 may select a document of a partition with a large number ofdocument members to include in the guide set. The partition module 212may identify partitions with a large number of document members in anynumber of ways. For example, the partition module 212 may identify thepartition with the largest number of document members.

The method may return to step 504 and the process may continue asdepicted whereby the partition module 212 may retrieve distances betweeneach document in the search result and each document in the alteredguide set to create new partitions.

In some embodiments, the partition module 212 may track the number oftimes any or all of steps 508-514 are performed. If the partition module212 generates new partitions based on partitions with insufficientmembers too many times (e.g., the tracked number of iterations of steps508-514 equals or exceeds an iteration threshold), the process may end.

FIG. 6A and 6B depict other flowcharts for partitioning search resultsin some embodiments. In some embodiments, the search database module 208may store only some of the distances between documents calculated by thedistance module 206 (e.g., for reasons of speed or memory efficiencydepending on the size of the corpus set). As a result, the partitionmodule 212 may not be able to retrieve distances between documents insearch result set and guide sets. In some embodiments, the partitionmodule 212 may approximate distances if distances between documents inthe search results and documents in the guide set are not available inthe search database 222.

FIG. 6A depicts a flowchart for a process in which the text analysissystem 104 determines to store fewer than all distance calculations inthe search database 222 in some embodiments. In some embodiments, thetext analysis system 104 may store the distances between each documentand a collection of that document's nearest neighbors (e.g., 200 nearestneighbors).

In step 602, the distance module 206 calculates distances between alldocuments in corpus set using text metric as discussed herein. In step604, if the number of documents in the corpus set is greater than acorpus threshold, the distance module 206 may identify, for eachdocument, a predetermined number of nearest documents using thecalculated distances. For example, for each document in the corpus, thedistance module 206 may determine the closest 20 documents based on thepreviously calculated distances.

In step 606, the search database module 208 may store, for eachdocument, those distances to the identified nearest documents in thesearch database 222. In some embodiments, the search database 222 mayinclude, for each document, distance calculated between that documentand a predetermined number of nearest documents. Other distances may notbe stored.

Since not all distances may be stored, the partition module 212 may berequired to approximate distances to form partitions as shown in FIG.6B. For example, in step 608, the partition module 212 may select anumber of documents from search results to generate guide set ofdocuments as described herein.

In step 610, the partition module 212 may retrieve stored distances, ifpreviously calculated, between each document of search results and eachdocument in guide set. If the distance between a document in a searchresult and a document in the guide set has not been stored, then thepartition module 212 and/or the distance module 206 may approximate thedistance between the document in the search result and the document inthe guide set in step 612.

In some embodiments, the partition module 212 may utilize distancesbetween any number of documents that form a path from the initialdocument that is the starting point to the document in the guide set. Inone example, if the particular document of the search results and theparticular document of the guide set are part of a connected graph(e.g., connected based on distances calculated by the distance module206), the partition module 212 may use Dijkstra's algorithm toapproximate the distance. The approximation may then be utilized inplace of retrieving distances from the search database 222. If alldistances between each document in the search results and each documentin the guide set are retrieved or approximated, the process may continuein step 506 in FIG. 5.

FIG. 7 is a flowchart for generating labels associated with segments ofpotential interest of document members of a partition using a frequencystatistic in some embodiments. In step 702, for each document of eachpartition, the label module 214 selects a predetermined number ofsegments with the highest frequency statistics when compared to othersegments of that document. For example, for each document of apartition, the label module 214 may identify a predetermined number ofsegments (e.g., 20) with the highest frequency statistics. In someembodiments, the text selection module 204 may calculate the frequencystatistics for segments in a document and then may store the segments ofpotential interest corresponding to the highest frequency statistics(e.g., the top twenty segments of potential interest based on alikelihood function as described herein). In various embodiments, thetext selection module 204 may order the segments of potential interestbased on frequency statistic and save the segments in that order. Thelabel module 214 may retrieve those segments of potential interest instep 702.

In step 704, for each document of each partition, the label module 214weights each selected segment based on frequency statistic with theselected segment having the highest frequency statistic having thegreatest weight and the selected segment having the lowest frequencystatistic having the lowest weight. It will be appreciated that thesegments of potential interest may be weighted in any number of ways.

In step 706, for member documents of a partition, the label module 214identifies similar selected segments between two or more documents andrecalculates weighted frequency statistic for each similar selectedsegment using previously calculated weighted, frequency statistics forthat selected segment. For example, if two or more documents identifythe “synchrocyclotron” as a top segment of potential interest, the labelmodule 214 may combine the weighted, frequency statistic from bothdocuments and recalculate a new weighted frequency statistic (e.g., thenew weighted, frequency statistic of the segment of potential interestbeing significantly larger than the two previous weighted frequencystatistics associated with the previous documents).

In step 708, for each partition, the label module 214 identifies apredetermined number of segments with the highest weighted frequencystatistic across all member documents of that partition. For example,the label module 214 may select the top 10 segments with the highestweighted frequency statistic across all member documents of thatpartition.

In step 710, for each partition, the label module 214 stores (e.g., inthe search database 222) and provides the identified, predeterminednumber of segments with the highest weighted frequency statistic acrossmember documents. The provided segments may be provided as labels toassist the user to better understand the search results and contents ofdocuments.

In step 712, for each partition, the label module 214 or the clientdevice 106 may display the provided predetermined number of segmentswith the highest weighted frequency statistic across member documents.The display is shown in screenshots of exemplary interfaces herein.

FIG. 8 is a flowchart for restricting a set of documents in someembodiments. In step 802, the restriction module 216 receives arestricted selection of documents. For example, a user may select one ormore partitions and/or one or more documents. The selection mayrepresent a subset of the set of documents the user is exploring usingthe search client module 108. The previous state (e.g., the previous setof documents) of the documents being explored by the user may be theinitial search results and/or the result of any restrictions and/orexpansions as described with regard to FIGS. 8 and 9.

In step 804, the restriction module 216 identifies documents ofrestricted selection. In some embodiments, the restricted selection mayidentify segments of potential interest, labels, metadata, and/or anyother data. The restriction module 216 may identify related documentsbased on information of the restriction.

In step 806, the partition module 212 may, for each document identifiedbased on the restricted selection, partition documents using text metric(e.g., based on calculated distances) as described with respect to thepartition module 212 and FIGS. 3-5 herein.

In step 808, for each partition of restricted search results, the labelmodule 214 may determine labels of member documents to identify at leastsome segments of potential interest using frequency statistic asdescribed with respect to the label module 214 and FIG. 7 herein.

In step 810, for each partition, the search module 210, label module214, restriction module 216, and/or user device may display or assist indisplaying features of member documents (e.g., a graph or otherinformation), labels from the label module 214, or any otherinformation.

It will be appreciated that the user may further view information,including labels, associated with the restricted selection and mayperform other functions (e.g., further restricting or expanding the newoutput) using the documents associated with the restricted selection orperform a new search on the same or different documents.

FIG. 9 is a flowchart for receiving an expanded selection in someembodiments. In step 902, the expand module 218 may receive an expandedselection identifying selected documents. As similarly discussedregarding a restricted selection, the expanded selection may represent asubset of the set of documents the user is exploring using the searchclient module 108. The previous state (e.g., the previous set ofdocuments) of the documents being explored by the user may be theinitial search results and/or the result of any restrictions and/orexpansions as described with regard to FIGS. 8 and 9.

In step 904, the expand module 218 may receive an expanded selection,identify documents associated with the expanded selection, and determinethe nearest neighbors of documents in the corpus set to documents in theexpanded selection. For example, the expand module 218 may identifydocuments associated with expanded selection (e.g., either by documentidentifier or by identify documents related to selected labels, segmentsof potential interest, or any other information). The expand module 218may determine a number of nearest neighbors (e.g., 20) of nearestneighbor documents in the corpus set using the distances calculated bythe distance module 206. The selected documents and the nearestneighbors may be included in an expanded selection set of documents instep 906.

In step 908, the partition module 212 may partition the expandedselection set of documents as described herein (see steps 502-506 inFIG. 5 for example). Further, in step 910, as similarly described, thelabel module 214 may generate labels using the expanded selection set ofdocuments. In step 912, the search module 210 may provide theidentifiers of the documents in the expanded selection set, new labels,and/or any other information to the client device 106.

FIG. 10 is a functional block diagram of a digital device 1000 in someembodiments. The digital device 1000 includes a data processing device1002 (e.g., a processor), a memory system 1004 (e.g., non-transitorymemory), a storage system 1006, a communication network interface 1008,an I/O interface 1010, and a display interface 1012 communicativelycoupled to a bus 1014. The data processing device 1002 is incommunication with the memory system 1004, the storage system 1006, thecommunication network interface 1008, the I/O interface 1010, and thedisplay interface 1012. The data processing device 1002 is alsoconfigured to execute executable instructions (e.g., programs stored onthe memory system 1004 or the storage system 1006). In some examples,the data processing device 1002 includes circuitry or any dataprocessing device capable of processing the executable instructions.

The memory system 1004 is any non-transitory memory configured to storedata. Some examples of the memory system 1004 are storage devices, suchas RAM or ROM. The memory system 1004 can comprise the ram cache. Thedata within the memory system 1004 may be cleared or ultimatelytransferred to the storage system 1006.

The storage system 1006 is any storage configured to retrieve and storedata. Some examples of the storage system 1006 are flash drives, harddrives, optical drives, and/or magnetic tape. The storage system 1006may comprise non-transitory media. In some implementations, the digitaldevice 1000 includes a memory system 1004 in the form of RAM and astorage system 1006 in the form of flash data. Both the memory system1004 and the storage system 1006 include computer readable media whichmay store instructions or programs that are executable by a computerprocessor including the data processing device 1002.

The communication network interface (com. network interface) 1008 can becoupled to a network (e.g., network 110) via the link 1016. Thecommunication network interface 1008 may support communication over anEthernet connection, a serial connection, a parallel connection, or anATA connection, for example. The communication network interface 1008may also support wireless communication (e.g., 802.11 a/b/g/n, WiMax).Moreover, the communication network interface 1008 can support manywired and wireless standards.

The optional input/output (I/O) interface 1010 is any device thatreceives input from the user and output data. The optional displayinterface 1012 is any device that is configured to output graphics anddata to a display. In some examples, the display interface 1012 is agraphics adapter. While not all digital devices include either the I/Ointerface 1010 or the display interface 1012, the digital device 1000may include either, both, or none.

The hardware elements of the digital device 1000 are not limited tothose depicted in FIG. 10. A digital device 1000 may comprise more orless hardware elements than those depicted. Further, hardware elementsmay share functionality and still be within various implementationsdescribed herein. In some examples, encoding and/or decoding may beperformed by the data processing device 1002 and/or a co-processorlocated on a GPU (i.e., Nvidia).

FIG. 11A is an interface depicting a graph of search results and labelsfor partitions of the graph in some embodiments. FIG. 11B depicts thelabels and partitions of FIG. 11A. FIG. 11C depicts the graph of FIG.11A. The interface of FIG. 11A may be depicted on the client device 106(e.g., via the search client module 108).

FIG. 12A is an interface whereby a user has selected a label (e.g.,processor) and a document selection list was generated showing a list ofdocuments including associated labels for each document in someembodiments. FIG. 12B depicts labels and partitions of the graphincluding a selected partition. FIG. 12C depicts the graph of FIG. 12A.FIG. 12D depicts the document selection list of FIG. 12A.

FIG. 13A is an interface depicting a restricted selection by the user insome embodiments. For example, the user may have provided a restrictedselection of documents related to a partition of the documentsidentified in FIGS. 11A and 12A. The client device 106 may depict agraph of the restricted selection of documents along with labelsassociated with partitions of the restricted selection. The user mayhave also selected two sets of labels for two partitions including“display” and “camera.”

FIG. 13B depicts the labels and partitions of FIG. 13A. FIG. 13C depictsthe graph of FIG. 13A. FIG. 13D depicts the document selection list ofFIG. 13A showing a document list associated with the two selectedpartitions.

FIG. 14A is an interface depicting a selection of a partition associatedwith the label of “wearable_computer” by the user in some embodiments.FIG. 14B depicts the labels and partitions of FIG. 14A. FIG. 14C depictsthe graph of FIG. 14A. FIG. 14D depicts the document selection list ofFIG. 14A showing a document list associated with the selected partitions

FIG. 15A is an interface of an expanded selection of the“wearable_computer” partition by the user in some embodiments. FIG. 15Adepicts a new graph and partitions based on the expanded selection (theprocess of which is described herein. The graph of FIG. 15A depicts auser selection of a node (e.g., a document) and the selected document isdisplayed.

FIG. 15B depicts the labels and partitions of FIG. 15A. FIG. 15C depictsthe graph of FIG. 15A. FIG. 15D depicts the selected document of FIG.15A.

The above-described functions and components can be comprised ofinstructions that are stored on a storage medium such as a computerreadable medium (e.g., a non-transitory computer readable medium). Theinstructions can be retrieved and executed by a data processing device.Some examples of instructions are software, program code, and firmware.Some examples of storage medium are memory devices, tape, disks,integrated circuits, and servers. The instructions are operational whenexecuted by the data processing device to direct the data processingdevice to operate in accord with embodiments of the present disclosure.Those skilled in the art are familiar with instructions, data processingdevice(s), and storage medium.

The present disclosure is described above with reference to exemplaryembodiments. It will be apparent to those skilled in the art thatvarious modifications may be made and other embodiments can be usedwithout departing from the broader scope of the present disclosure.Therefore, these and other variations upon the exemplary embodiments areintended to be covered by the present disclosure.

The invention claimed is:
 1. A non-transitory computer readable mediumcomprising executable instructions, the instructions being executable bya data processing device to perform a method, the method comprising:receiving text from a plurality of documents; for each document of theplurality of documents: segmenting the received text of the particulardocument of the plurality of documents to create a set of segments; foreach of at least a subset of the set of segments: calculating a documentfrequency statistic indicating a frequency of a particular segment ofthe at least a subset of the segments within the particular document ofthe plurality of documents; comparing the document frequency statisticindicating the frequency of the particular segment within the particulardocument to a frequency threshold; determining if the particular segmentis a segment of potential interest based on the comparison of thedocument frequency statistic of the particular segment to the frequencythreshold; and calculating a distance between the particular document ofthe plurality of documents and each of the other documents of theplurality of documents using a text metric; receiving a search query andperforming a search on the received text of the plurality of documentsto generate search results, the search results including at least asubset of documents of the plurality of documents; dividing the at leastthe subset of the documents of the plurality of documents of the searchresults between a first set and a guide set; for each of the documentsof the first set, determining a closest document of the guide set usingthe distances for that particular document to create partitions ofdocuments; for each partition of documents: retrieving the documentfrequency statistics of each segment of potential interest of eachdocument in the particular partition of documents; selecting apredetermined number of segments of potential interest of the documentsin the particular partition of documents based on a highest frequencystatistic of the retrieved document frequency statistics; anddetermining identifying information associated with at least somecontent of the predetermined number of segments of potential interest ofthe documents in the particular partition of documents; and providingthe identified content of at least one partition for display.
 2. Thenon-transitory computer readable medium of claim 1, the method furthercomprising providing the identified content for all of the partitions.3. The non-transitory computer readable medium of claim 1, the methodfurther comprising displaying the identified content of the at least onepartition.
 4. The non-transitory computer readable medium of claim 1,the method further comprising generating a graph of nodes and edgesconnecting nodes, where each node represents a document of the searchresults and each edge between nodes is based on a particular distancebetween documents.
 5. The non-transitory computer readable medium ofclaim 1, wherein calculating the document frequency statistic utilizes alog likelihood function, wherein calculating the document frequencystatistics comprises: determining an expected segment score based on atotal number of times the particular segment is within the plurality ofdocuments relative to a total number of segments in the plurality ofdocuments; determining an observed score based on a total number oftimes the particular segment is within the particular document of theplurality of documents; and generating a log likelihood function scorebased on the observed score relative to the expected score.
 6. Thenon-transitory computer readable medium of claim 5, wherein determiningif the particular segment is the segment of potential interest comprisescomparing the log likelihood function score associated with theparticular segment to a likelihood threshold.
 7. The non-transitorycomputer readable medium of claim 1, wherein the distance is a result ofapplying a cosine term frequency-inverse document frequency (tf-idf). 8.The non-transitory computer readable medium of claim 1, the methodfurther comprising filtering the text to remove common or unwantedphrases.
 9. The non-transitory computer readable medium of claim 1, themethod further comprising approximating a distance measure between twodocuments in the search results using a Dijkstra's algorithm.
 10. Asystem comprising: at least one processor; and memory, the memoryincluding executable instructions that when executed by the at least oneprocessor performs the steps of: receiving text from a plurality ofdocuments; for each document of the plurality of documents: segmentingthe received text of the particular document of the plurality ofdocuments to create a set of segments; for each of at least a subset ofthe set of segments: calculating a document frequency statisticindicating a frequency of a particular segment of the at least a subsetof the segments within the particular document of the plurality ofdocuments; comparing the document frequency statistic indicating thefrequency of the particular segment within the particular document to afrequency threshold; determining if the particular segment is a segmentof potential interest based on the comparison of the document frequencystatistic of the particular segment to the frequency threshold; andcalculating a distance between the particular document of the pluralityof documents and each of the other documents of the plurality ofdocuments using a text metric; receiving a search query and performing asearch on the received text of the plurality of documents to generatesearch results, the search results including at least a subset ofdocuments of the plurality of documents; dividing the at least thesubset of the documents of the plurality of documents of the searchresults between a first set and a guide set; for each of the documentsof the first set, determining a closest document of the guide set usingthe distances for that particular document to create partitions ofdocuments; for each partition of documents: retrieving the documentfrequency statistics of each segment of potential interest of eachdocument in the particular partition of documents; selecting apredetermined number of segments of potential interest of the documentsin the particular partition of documents based on a highest frequencystatistic of the retrieved document frequency statistics; anddetermining identifying information associated with at least somecontent of the predetermined number of segments of potential interest ofthe documents in the particular partition of documents; and providingthe identified content of at least one partition for display.
 11. Thesystem of claim 10, wherein the steps further comprise providing theidentified content for all of the partitions.
 12. The system of claim10, wherein the steps further comprise displaying the identified contentof the at least one partition.
 13. The system of claim 10, wherein thesteps further comprise generating a graph of nodes and edges connectingnodes, wherein each node represents a document of the search results andeach edge between nodes is based on a particular distance betweendocuments.
 14. The system of claim 10, wherein calculating the documentfrequency statistic utilizes a log likelihood function, whereincalculating the document frequency statistics comprises: determining anexpected segment score based on a total number of times the particularsegment is within the plurality of documents relative to a total numberof segments in the plurality of documents; determining an observed scorebased on a total number of times the particular segment is within theparticular document of the plurality of documents; and generating a loglikelihood function score based on the observed score relative to theexpected score.
 15. The system of claim 14, wherein determining if theparticular segment is the segment of potential interest comprisescomparing the log likelihood function score associated with theparticular segment to a likelihood threshold.
 16. The system of claim10, wherein the distance is a result of applying a cosine termfrequency-inverse document frequency (tf-idf).
 17. The system of claim10, wherein the steps further comprise filtering the text to removecommon or unwanted phrases.
 18. The system of claim 10, wherein thesteps further comprise approximating a distance measure between twodocuments in the search results using a Dijkstra's algorithm.
 19. Amethod comprising: receiving text from a plurality of documents; foreach document of the plurality of documents: segmenting the receivedtext of the particular document of the plurality of documents to createa set of segments; for each of at least a subset of the set of segments:calculating a document frequency statistic indicating a frequency of aparticular segment of the at least a subset of the segments within theparticular document of the plurality of documents; comparing thedocument frequency statistic indicating the frequency of the particularsegment within the particular document to a frequency threshold;determining if the particular segment is a segment of potential interestbased on the comparison of the document frequency statistic of theparticular segment to the frequency threshold; and calculating adistance between the particular document of the plurality of documentsand each of the other documents of the plurality of documents using atext metric; receiving a search query and performing a search on thereceived text of the plurality of documents to generate search results,the search results including at least a subset of documents of theplurality of documents; dividing the at least the subset of thedocuments of the plurality of documents of the search results between afirst set and a guide set; for each of the documents of the first set,determining a closest document of the guide set using the distances forthat particular document to create partitions of documents; for eachpartition of documents: retrieving the document frequency statistics ofeach segment of potential interest of each document in the particularpartition of documents; selecting a predetermined number of segments ofpotential interest of the documents in the particular partition ofdocuments based on a highest frequency statistic of the retrieveddocument frequency statistics; and determining identifying informationassociated with at least some content of the predetermined number ofsegments of potential interest of the documents in the particularpartition of documents; and providing the identified content of at leastone partition for display.